Scalability of Transient CFD on Large-Scale Linux Clusters with Parallel File Systems
نویسندگان
چکیده
This work examines the parallel scalability characteristics of commercial CFD software FLUENT and STAR-CD for up to 256 processing cores, and research CFD software CDP from Stanford University for up to 512 cores – for transient CFD simulations that heavy in IO relative to numerical operations. In three independent studies conducted with engineering contributions from the University of Cambridge, Intel, SGI, and Panasas, each Linux HPC environment combined Intel Xeon clusters with a Panasas parallel file system and shared storage. The motivation for these studies was to quantify the performance and scalability benefits of parallel IO in CFD software on a parallel file system (PanFS) verses a conventional serial NFS file system for a variety of transient CFD cases.
منابع مشابه
Improving the Performance of the POSIX I/O Interface to PVFS
The ever-increasing gap in performance between CPU/memory technologies and the I/O subsystem (disks, I/O buses) in modern workstations has exacerbated the I/O bottlenecks inherent in applications that access large disk resident data sets. A simultaneous development in recent times has seen the maturity of Linux-based offthe-shelf clusters of PCs for low-cost, high-performance computing solution...
متن کاملEvaluating the Shared Root File System Approach for Diskless High-Performance Computing Systems
Diskless high-performance computing (HPC) systems utilizing networked storage have become popular in the last several years. Removing disk drives significantly increases compute node reliability as they are known to be a major source of failures. Furthermore, networked storage solutions utilizing parallel I/O and replication are able to provide increased scalability and availability. Reducing a...
متن کاملGPFS: A Shared-Disk File System for Large Computing Clusters
GPFS is IBM’s parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters. GPFS is used on many of the largest supercomputers in the world. GPFS was built on many of the ideas that were developed in the academic community over the last several years, particularly distributed locking and recovery technology. To date it has bee...
متن کاملpNFS and Linux: Working Towards a Heterogeneous Future
Heterogeneous and scalable remote data access is a critical enabling feature of widely distributed collaborations. Parallel file systems feature impressive throughput, but sacrifice heterogeneous access, seamless integration, security, and cross-site performance. Remote data access tools such as NFS and GridFTP provide secure access to parallel file systems, but either lack scalability (NFS) or...
متن کاملPVFS: A Parallel File System for Linux Clusters
As Linux clusters have matured as platforms for lowcost, high-performance parallel computing, software packages to provide many key services have emerged, especially in areas such as message passing and networking. One area devoid of support, however, has been parallel file systems, which are critical for highperformance I/O on such clusters. We have developed a parallel file system for Linux c...
متن کامل